Automated data reduction workflows for astronomy

Online Input Data Reduction in Scientific Workflows

Many scientific workflows are data-intensive and need be iteratively executed for large input sets of data elements. Reducing input data is a powerful way to reduce overall execution time in such workflows. When this is accomplished online (i.e., without requiring users to stop execution to reduce the data and resume execution), it can save much time and user interactions can integrate within w...

Automated Metadata Generation for Linked Data Generation and Publishing Workflows

Provenance and other metadata are essential for determining ownership and trust. Nevertheless, no systematic approaches were introduced so far in the Linked Data publishing workflow to capture them. Defining such metadata remained independent of the rdf data generation and publishing. In most cases, metadata is manually defined by the data publishers (person-agents), rather than produced by the...

Program for Automated Holographic Data Reduction

Big Data Exploration Via Automated Orchestration of Analytic Workflows

Large-scale data exploration using Big Data platforms requires the orchestration of complex analytic workflows composed of atomic analytic components for data selection, feature extraction, modeling and scoring. In this paper, we propose an approach that uses a combination of planning and machine learning to automatically determine the most appropriate data-driven workflows to execute in respon...

Automated Workflows for Luminex xMAP Assays

Bead-based, multiplexing assays such as those provided by the Luminex xMAP technology, have proven to be highly useful for biomarker identification and quantification from cells, tissues and body fluids. Applications include biological research, drug discovery and clinical diagnostics. The original technology based on the use of polystyrene microspheres tends to have arduous, manual work flows ...